A Student-Teacher Architecture for Dialog Domain Adaptation Under the Meta-Learning Setting
نویسندگان
چکیده
Numerous new dialog domains are being created every day while collecting data for these is extremely costly since it involves human interactions. Therefore, essential to develop algorithms that can adapt different efficiently when building data-driven models. Most recent research on domain adaption focuses giving the model a better initialization, rather than optimizing adaptation process. We propose an efficient adaptive task-oriented system model, which incorporates meta-teacher emphasize impacts between generated tokens with respect context. first train our base and adversarially in meta-learning setting rich-resource domains. The learns quantify importance of under contexts across During adaptation, guides focus important order achieve efficiency. evaluate two multi-domain datasets, MultiWOZ Google Schema-Guided Dialogue, state-of-the-art performance.
منابع مشابه
Adversarial Teacher-Student Learning for Unsupervised Domain Adaptation
The teacher-student (T/S) learning has been shown effective in unsupervised domain adaptation [1]. It is a form of transfer learning, not in terms of the transfer of recognition decisions, but the knowledge of posteriori probabilities in the source domain as evaluated by the teacher model. It learns to handle the speaker and environment variability inherent in and restricted to the speech signa...
متن کاملLarge-Scale Domain Adaptation via Teacher-Student Learning
High accuracy speech recognition requires a large amount of transcribed data for supervised training. In the absence of such data, domain adaptation of a well-trained acoustic model can be performed, but even here, high accuracy usually requires significant labeled data from the target domain. In this work, we propose an approach to domain adaptation that does not require transcriptions but ins...
متن کاملTeacher-Student Curriculum Learning
We propose Teacher-Student Curriculum Learning (TSCL), a framework for automatic curriculum learning, where the Student tries to learn a complex task and the Teacher automatically chooses subtasks from a given set for the Student to train on. We describe a family of Teacher algorithms that rely on the intuition that the Student should practice more those tasks on which it makes the fastest prog...
متن کاملTeacher-Student Framework: A Reinforcement Learning Approach
We propose a reinforcement learning approach to learning to teach. Following Torrey and Taylor’s framework [18], an agent (the “teacher”) advises another one (the “student”) by suggesting actions the latter should take while learning a specific task in a sequential decision problem; the teacher is limited by a “budget” (the number of times such advice can be given). Our approach assumes a princ...
متن کاملSample-oriented Domain Adaptation for Image Classification
Image processing is a method to perform some operations on an image, in order to get an enhanced image or to extract some useful information from it. The conventional image processing algorithms cannot perform well in scenarios where the training images (source domain) that are used to learn the model have a different distribution with test images (target domain). Also, many real world applicat...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2021
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v35i15.17614